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Method and System for Calendar-Based Image Asset Organization 

FIELD OF THE INVENTION 

The present invention relates to organization of content, and in 
particular to organization of images based on dates. 

BACKGROUND OF THE INVENTION 

With today's growth and advances in image capture devices, 
digital images are proliferating at a rate nearly equal to that of traditional film- 
based photographs. Digital scanners and digital still and video cameras with 
mega-pixel resolutions are becoming more and more affordable, and producing 
higher and higher quality images. 

Conventional film-based photographs and video reels have often 
been saved in numerous photo albums and "shoe boxes". As users of digital 
capture devices accumulate numbers of images into the thousands, organization of 
their images becomes nearly intractable. In order to be able to efficiently access 
their digital images using prior art hardware and software, users are typically 
required to manually classify images in terms of categories and sub-categories, or 
by key words or captions, or to manually save them within appropriate file folders 
and sub-folders. If a user's selection of categories and sub-categories, or folders 
and sub-folders is not carefully planned, search and retrieval of desired images 
will be overly time-consuming, and the user may have to re-classify his entire 
archive of images. Consider, for example, how time consuming it typically is for a 
user to locate a specific e-mail he received a year ago, within the thousands of e- 
mails he receives per year; even more so with digital images, which are intended 
to be preserved for generations. 

Thus a major concern of users of digital images today is efficient 
archival and retrieval, for large archives of images over long time spans. 
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SUMMARY OF THE INVENTION 

The present invention provides a method and system for 
organizing digital images in an automatic and transparent way, without requiring 
5 manual work on the part of a user. The present invention uses dates of images for 

automatic storage and retrieval, so that a user can access his images according to 
their dates. In fact, this approach resembles the way people often save film-based 
photographs in shoe boxes, according to chronological events such as "Birthday 
Party 1968", "Wedding 1978" and "Summer Vacation "1988". Capture devices 
10 generally write a digital date and time stamp within image files. The present 

invention uses this information automatically without requiring manual entry by a 
user. 

In a preferred embodiment of the present invention, the date 
information upon which storage and retrieval relies is a capture date recorded with 

15 an image at its time of acquisition. Such a date is available within an 

Exchangeable Image File (EXIF) file header. EXIF is a standard format for 
storing interchange information in image files, especially for images that are 
stored using JPEG compression. The EXIF format is part of the Design Rules for 
Camera File System (DCF) standard created by the Japanese Electronic Industry 

20 Development Association (JEIDA), to encourage interoperability between 

imaging devices. EXIF supports the storage of extended camera information 
within the header of each JPEG file, including inter alia the date & time the image 
was taken, exposure information (ISO, shutter, aperture) and other extended 
camera details. Today, most digital cameras use the EXJF format. 

25 The present invention preferably includes a graphical user 

interface having a calendar display, making it intuitive and easy for a user to 
select a date range, and for viewing images having a date within the selected 
range. 

There is thus provided in accordance with a preferred 
30 embodiment of the present invention a calendar-based image asset organizer, 

including a user interface for designating at least one date range, an image date 
reader for determining a date associated with an image, and an image query 
manager for identifying images having an associated date within the designated at 
least one date range. 

35 There is further provided in accordance with a preferred 

embodiment of the present invention a method for organizing image assets, 
including receiving at least one designated date range, determining dates 
associated with images, and identifying images having an associated date within 
the at least one designated date range. 
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There is yet further provided in accordance with a preferred 
embodiment of the present invention a computer-readable storage medium storing 
program code for causing a computer to perform the steps of receiving at least one 
designated date range, determining dates associated with images, and identifying 
5 images having an associated date within the at least one designated date range. 

There is moreover provided in accordance with a preferred 
embodiment of the present invention a calendar-based digital content organizer, 
including a user interface for designating at least one date range, a date reader for 
determining dates associated with digital content, and a query manager for 
10 identifying digital content having an associated date within the at least one 

designated date range. 

There is additionally provided in accordance with a preferred 
embodiment of the present invention a method for organizing digital content, 
including receiving at least one designated date range, determining dates 
15 associated with digital content, and identifying digital content having an 

associated date within the at least one designated date range. 

There is further provided in accordance with a preferred 
embodiment of the present invention a computer-readable storage medium storing 
program code for causing a computer to perform the steps of receiving at least one 
20 designated date range, determining dates associated with digital content, and 

identifying digital content having an associated date within the at least one 
designated date range. 
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BRIEF DESCRIPTION OF THE DRAWINGS 



The present invention will be more fully understood and 
appreciated from the following detailed description, taken in conjunction with the 
drawings in which: 

FIG. 1 is an illustration of a calendar pane year view within a 
user interface, in accordance with a preferred embodiment of the present 
invention; 

FIG. 2 is an illustration of a calendar pane month view within a 
user interface, in accordance with a preferred embodiment of the present 
invention; 

FIG. 3 is an illustration of a calendar pane day view within a user 
interface, in accordance with a preferred embodiment of the present invention; 

FIG. 4 is a simplified block diagram for a calendar-based image 
asset organizer, in accordance with a preferred embodiment of the present 
invention; and 

FIG. 5 is a simplified flowchart for organizing image assets, in 
accordance with a preferred embodiment of the present invention. 
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DETAILED DESCRIPTION OF A PREFERRED EMBODIMENT 



The present invention overcomes limitations of prior art image 
organization software and hardware, which require considerable manual user 
5 effort to organize large image archives by classification in terms of category and 

sub-category, or in terms of captions, or in terms of key words. The present 
invention provides a method and system for automatic organization of image 
assets according to dates associated therewith. 

10 User Interface 

Reference is now made to FIG. 1, which is an illustration of a 
calendar pane year view within a user interface, in accordance with a preferred 
embodiment of the present invention. Shown in FIG. 1 is a graphical user 
interface window 100 including a pane 110 displaying a calendar of years. 

15 Within each year is preferably indicated a number, indicating the number of 

images available within a user's image archive, having associated dates within 
such year. When a user left-clicks on a displayed year, he can view the images 
having associated dates within such year. Preferably, representations 120 of the 
images are displayed, the representations being small-scale versions of the 

20 images, such as thumbnail versions. In a preferred embodiment of the present 

invention, the user can view a full-scale version of an image by double-clicking 
on a representation 120 thereof. 

When the user right-clicks on a displayed year, a pop-up box 130 
appears, displaying the months of the year and the number of images having 

25 associated date within each such month. When the user subsequently clicks on 

one of the months within pop-up box 130, the user interface preferably switches 
to a calendar pane month view for such month, as illustrated below in FIG. 2. 
Also, when the user double clicks on a displayed year, representations 120 of 
images having associated dates within such year are displayed, and the user 

30 interface switches to the calendar pane month view for the months of such year. 

It may be appreciated by those skilled in the art that the vertical 
layout of FIG. 1 whereby a calendar pane is at the left and image files are 
displayed at the right can be modified to a horizontal layout whereby the calendar 
as at the top and image files are displayed at the bottom. FIGS. 2 and 3 below can 

35 also be modified to such a horizontal layout. 

Reference is now made to FIG. 2, which is an illustration of a 
calendar pane month view within a user interface, in accordance with a preferred 
embodiment of the present invention. Shown in FIG. 2 is a graphical user 
interface window 200 including a pane 210 displaying a calendar of months. 

40 Preferably, the months are displayed with days in a single combined view. When 
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a user left-clicks within a displayed month, representations 220 of images having 
an associated date within such month are displayed. Similarly, when the user left- 
clicks on a displayed day within a displayed month, representations 220 of images 
having an associated date the same as such day are displayed. Preferably, the user 
5 can select one or more ranges of days, to view images having an associate dates 

within the one or more selected ranges. For example, a user may click on a 
weekday, such as Tuesday, to select all Tuesdays of a specific month. 

When the user double clicks on a displayed day, representations 
220 of images having an associated date the same as such day are displayed, and 
10 the user interface switches to calendar pane day view, as illustrated below in FIG. 

3. 

Reference is now made to FIG. 3, which is an illustration of a 
calendar pane day view within a user interface, in accordance with a preferred 
embodiment of the present invention. Shown in FIG. 3 is a graphical user 

15 interface window 300 including a pane 310 displaying a calendar of hours and 

days. In a preferred embodiment of the present invention, the date information 
associated within an image includes both a date and a time. When a user left- 
clicks on a displayed day, representations 320 of images having an associated date 
within such day are displayed. When the user left-clicks on a displayed hour, 

20 representations 320 of images having an associated date within such hour are 

displayed. Preferably, the user can select one or more ranges of hours, to view 
images having a associated date within the one or more selected ranges. 

In a preferred embodiment of the present invention, organization 
of images by dates can be based upon any of the following dates: 

25 (i) an image capture date as stored within a file header, such as an EXIF file 

header, by an image capture device; 

(ii) a file system date, such as the date a file containing an image was last 
modified; and 

(iii) a date manually entered by a user. 

30 It may be appreciated that not all digital images necessarily have image capture 

dates associated therewith. To facilitate organization of images, some of which 
do and other of which do no have capture dates, the present invention preferably 
combines (i) and (iii) by copying existing capture dates into a database, which can 
be manually updated by a user. Thus, the user need only enter manual dates for 

35 those images that do not have capture dates available. 

An advantage of using dates as keys for image assets is that 
helpful date-oriented functionality can be incorporated into the user interface. 

One such functionality is the ability to step through image assets 
by jumping forward to the next year, month or day associated with one or more 

40 images, and backward to the previous year, month or day associated with one or 
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more images. The forward and backward jumps automatically skip over dates 
that have no images associated therewith. Such functionality enables a user to 
browse his images event by event, since generally events are clustered within 
individual days. With reference to FIGS. 1 - 3, a user can jump forward to the 
5 next year, month or day associated with one or more images when the calendar 

pane year, month or day is displayed, respectively, by pressing on the <cursor up> 
keyboard button, and he can jump backward by pressing on the <cursor down> 
key. 

Another such functionality is display of an appropriate image 
10 within the background of a year, month or day in the calendar. For example, with 

reference to the calendar pane year displayed in FIG. 2, the region in which 
January 1997 is rendered can have a thumbnail for a first image associated with 
January 1997, as a transparent background. 

Another such functionality is visually marking of dates in the 
15 calendar corresponding to one or more selected images. 

Another such functionality is highlighting of images that are 
associated with a specific date, when a user hovers his mouse pointer over a 
display of the date. Preferably, the image associated with the date are not 
selected, but only highlighted so as to make them stand out visually. Such 
20 functionality provides a user with a preview of the images that would be 

displayed if he were to proceed and click on the date. 

Implementation Details 

In a preferred embodiment of the present invention, one or more 
25 relational database tables are used to store and retrieve date information for image 

assets. It may be appreciated by those skilled in the art that other data structures 
may be used in alternative embodiments of the present invention. For example, 
image date information may be stored in a tree data structure, with branching 
based on date. Similarly, image date information may also be stored in a linked 
30 list, ordered chronologically, or in a dynamic array; i.e., an array that can expand 

and shrink. 

Reference is now made to FIG. 4, which is a simplified block 
diagram for a calendar-based image asset organizer 400, in accordance with a 
preferred embodiment of the present invention. Shown in FIG. 4 is an image 
35 viewer 410, used to render image pixel data for display by a video graphics 

processor on a computer monitor. Image viewer 410 includes a user interface 
420, such as the user interface illustrated hereinabove in FIGS. 1 - 3, through 
which a user designates one or more date ranges. 

Image viewer 410 communicates with a database manager 430, 
40 which stores and retrieves data from a relational database system. In a preferred 
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embodiment of the present invention, the relational database system includes 
tables, described hereinbelow, through which images having an associated date 
within the one or more designated date ranges are identified. Specifically, 
database manager 430 provides image viewer 410 with image file identifiers for 
such images. In a preferred embodiment of the present invention, database 
manager 430 also provides thumbnail representations for such images, which are 
stored within the relational database tables as binary data.. 

Alternatively, database manager 430 may provide image viewer 
with one or more statistics about the images having dates within the one or more 
designated date ranges. For example, database manager 430 may provide the 
number of image within the designated ranges, as illustrated hereinabove in FIG. 
1. 

Image viewer 410 also communicates with a file system manager 
440, which stores and retrieves file data from a computer file system. Image 
viewer 410 requests data from files specified by image file identifiers, and file 
system manager 440 provides the requested data. 

Preferably, when a user double clicks on a thumbnail of an 
image, the full resolution image is displayed. In a preferred embodiment of the 
present invention, data provided by file system manager 440 includes full 
resolution pixel data from image files. 

Alternatively, the thumbnail representations themselves may be 
stored within the file system, in which case file system manager 440 provides the 
thumbnails upon request. 

In a preferred embodiment of the present invention, a relational 
database table is used to relate dates to image files, as follows: 



TABLE I: Date - File ID Relationship 




Date-Time 
(CCYYMMDDHH:mm:SS) 


Date Convention 


File ID 


2003070621:49:30 


0 = manually entered date 


1-NNNNNNNNNN 


2003070621:49:30 


1 = EXIF header date 


1 -NNNNNNNNNN 


2003070621:49:30 


2 = file last modified date 


1-NNNNNNNNNN 



The File ID entry is a foreign key for TABLE II below. As a pair of entries, the 
Date Source and File ED entries form a unique key for TABLE I. However, 
multiple File ID's may have the same Date-Time and Date Convention entries. 
Similarly, the same File ID may have multiple Date-Time entries (corresponding 
to different Date Conventions). 

In a preferred embodiment of the present invention, a relational 
database table is used to relate file ID's to folders and file names, as follows: 
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TABLE II: File ID - Folder ID + File Name Relationship 


Folder ID 


File Name 


File ID 


12345 


PICTURE.JPG 


1-NNNNNNNNNN 



The Folder ID entry is a foreign key for TABLE m below. The File ID entry is a 
unique key for TABLE H 

In a preferred embodiment of the present invention, a relational 
database table is used to relate folder ID's to folder names, as follows: 



TABLE B3: Folder ID - Folder Name Relationship 


Folder Name 


Folder ID 


C:\TOP\SUB\PICTURES\ 


N 


C :\TOP\SUB\PICTURES\FAMILY 


N+l 



The Folder ID field is a unique key for TABLE m. 

In a preferred embodiment of the present invention, database 
manager 430 listens for events from file system manager 440. Specifically, if a 
user moves a file to a different folder, or changes the name of the file, then 
database manager 430 receives an event notification and is able to dynamically 
update TABLES II and m accordingly. This mechanism ensures that TABLES II 
and III are synchronized with the file system. 

Preferably, in order to generate unique ID's for folders and files, 
a table of latest used ID's is maintained, and a next ID is generated by adding 1 to 
the current ID. Specifically, the following TABLE IV maintains current ID 
information. 



TABLE IV: Folder ID - Folder > 


[ame Relationship 


Name 


m Tiff, mr & •* 

Current ID 


PATH NAME (KEY = "1") 


1-NNNNNNNNNN 


FILE NAME (KEY = "2") 


1-NNNNNNNNNN 



Preferably, whenever a next ID is assigned, TABLE IV is updated accordingly. 

Thumbnail pixel data for image assets may be stored within a file 
system, or within the relational database. In the latter case, preferably a table for 
retrieving thumbnail data is used to retrieve thumbnail data based on file ID. 
Specifically, the following TABLE V stores thumbnail data. 
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TABLE V: File ID - Thumbnail Data 


File ID 


i*. »XL*Z*wa*t *■ -- i ^ - * , ......... •>» r *v.< 

Thumbnail Data 


1-NNNNNNNNNN 


Blob of binary data 



The File ID field is a unique key for TABLE V. Alternatively, multiple 
thumbnail versions may be stored in TABLE V, in which case a field for 
Thumbnail Setting is included, similar to the Date Setting field in TABLE I. In 
this alternative embodiment, the pair of fields, File ID and Thumbnail Setting 
together, constitute a unique key. 

As illustrated hereinabove in FIGS. 1-3, the result of a date 
range query is often a multiplicity of image identifiers, and image thumbnails. To 
enable the client viewer to sequence through such a multiplicity, the present 
invention preferably supports the following two generic database commands: 
FindDataForKey("Key", &BufferReturned); 
ReadNext(&KeyReturned, &BufferReturned). 

The FindDataForKey method accepts a key name as input and produces a buffer 
address for retrieved data as output, corresponding to the first item within a 
multiplicity of query results. The ReadNext method provides the key name for 
the next item within a multiplicity of query results, and the corresponding buffer 
address for the data associated with the key. Thus it may be appreciated, that 
together the methods FindDataForKey and ReadNext enable the client viewer to 
sequentially retrieve a multiplicity of results. 

It will be apparent to those skilled in the art that there are several 
ways to populate the above tables. For example, a client application may initially 
scan specific folders in a user's hard disk, such as a default \My Pictures folder, 
for images and their metadata. The user may scan additional folders by activating 
a search for images. When the client application acquires new images by 
importing from a scanner or uploading from a digital camera, it may scan their 
metadata and enter them within the database at the time of acquisition. Since 
identification of image files and scanning their metadata are simple operations, a 
large archive of images can be scanned within minutes. Preferably, the database 
is persistent, and does not have to be reloaded again after the application is closed. 

Reference is now made to FIG. 5, which is a simplified flowchart 
for organizing image assets, in accordance with a preferred embodiment of the 
present invention. FIG. 5 is divided into three columns. The leftmost column 
indicates steps performed by an image viewer, such as image viewer 410 (FIG. 4). 
The middle column indicates steps performed by a database manager, such as 
database manager 430. The rightmost column indicates steps performed by a file 
system manager, such as file system manager 440. 



Any. Docket No. 



-10- 



At step 510 the image viewer displays a calendar-based graphical 
user interface, such as the year/month/day user interface illustrated hereinabove in 
FIGS. 1 - 3. At step 520 the image viewer identifies one or more date ranges 
designated by a user via the calendar interface. At step 530 the image viewer 
queries the database manager for information regarding images whose dates fall 
within the designated one or more date ranges. 

At step 540 the database manager performs the query, retrieves 
image file identifiers for the requested images and sends the identifiers back to the 
image viewer. In a preferred embodiment of the present invention, the database 
manager also sends thumbnail representations of the requested images. At step 
550 the image viewer requests file data from the file system manager, for files 
identified by the image file identifiers. The file data may include full resolutions 
image pixel data. If thumbnail representations are not delivered by the database 
manager, then the file data may also include the thumbnails. 

At step 560 the file system manager retrieves the requested 
image file data and sends the data back to the image viewer. Finally, at step 570 
the image viewer uses the image file data to display appropriate image data within 
the calendar-based user interface. 

The present invention has many diverse applications. It is 
apparent to those skilled in the art that the present invention is not limited to 
digital image organization, and may be applied to organization of other digital 
content. For example, the present invention may be used to organize animations, 
slide presentations, digital video content, electronic documents and e-mail, and a 
combination of such types of digital content. Similarly, the present invention may 
be used to organize albums of images instead of individual images, where the date 
associated with an album is, for example, the date of the earliest image in the 
album. Instead of displaying thumbnails for individual images in FIG. 1-3, the 
user interface displays thumbnails for albums. 

In reading the above description, persons skilled in the art will 
realize that there are many apparent variations that can be applied to the methods 
and systems described. One such variation is embodiment within a client-server 
environment, instead of a local environment. Thus, with respect to FIG. 4, 
database manager 430 and file system manager 440 may reside on server 
computers, networked together with a client computer that runs image viewer 
410. Database 430 preferably has a lock mechanism that prevents multiple 
clients from updating the database simultaneously. For example, a single lock 
byte (0 or 1) can be used for global locking. When the database is opened, a "1" 
is written to the lock byte, and when the database is closed a "0" is written to the 
lock byte. 
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An advantage of global locking is that the database manager can 
detect whether the database was closed cleanly the last time it was used. If not, 
then the database is repaired. 

It may be appreciated by those skilled in the art that other 
locking mechanisms may be employed, as are commonly used by database 
servers. 

A client-server network embodiment of the present invention has 
wide applicability to thin client devices that do not have the capability of storing 
large image archives. Specifically, the present invention provides powerful image 
asset organization for wireless devices such as wireless PDA's and cell phones. 

A client-server network embodiment of the present invention 
also has applicability to home networks, for organizing divers types of multi- 
media content. 

Another variation of the present invention is use of a calendar- 
based classification in conjunction with one or more other types of classification, 
such as folder or category based classifications, or more generally in conjunction 
with a search engine. Such variation of the present invention can provide, for 
example, independent calendars for individual folders or categories of images, 
and custom calendars for images satisfying specific search criteria. 

Alternatively, images from a specific category, from a specific 
folder or from specific search results can be identified within a single global 
calendar by multi-color markings. Days can be color coded so that green, for 
example, indicates a day for which all associated images satisfy specific search 
criteria; grey indicates a day for which some of the associated images satisfy the 
search criteria and other do not; and white indicates a day for which there are no 
associated images satisfying the search criteria. 

In the foregoing specification, the invention has been described 
with reference to specific exemplary embodiments thereof. It will, however, be 
evident that various modifications and changes may be made to the specific 
exemplary embodiments without departing from the broader spirit and scope of 
the invention as set forth in the appended claims. Accordingly, the specification 
and drawings are to be regarded in an illustrative rather than a restrictive sense. 
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